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ABSTRACT 

Purpose Many studies have reported on the use of 
narrow band imaging (NBI) colonoscopy to differentiate 
neoplastic from non-neoplastic colorectal polyps. It has 
potential to replace pathological diagnosis of diminutive 
polyps. We aimed to perform a systematic review and 
meta-analysis on the real-time diagnostic operating 
characteristics of NBI colonoscopy. 
Methods We searched PubMed, SCOPUS and 
Cochrane databases and abstracts. We used a two-level 
bivariate meta-analysis following a random effects model 
to summarise the data and fit hierarchical summary 
receiver-operating characteristic (HSROC) curves. The 
area under the HSROC curve serves as an indicator of 
the diagnostic test strength. We calculated summary 
sensitivity, specificity and negative predictive value 
(NPV). We assessed agreement of surveillance interval 
recommendations based on endoscopic diagnosis 
compared to pathology. 

Results For NBI diagnosis of colorectal polyps, the area 
under the HSROC curve was 0.92 (95% CI 0.90 to 
0.94), based on 28 studies involving 6280 polyps in 
4053 patients. The overall sensitivity was 91.0% (95% 
CI 87.6% to 93.5%) and specificity was 82.6% (95% 
CI 79.0% to 85.7%). In eight studies (n=2146 polyps) 
that used high-confidence diagnostic predictions, 
sensitivity was 93.8% and specificity was 83.3%. The 
NPVs exceeded 90% when 60% or less of all polyps 
were neoplastic. Surveillance intervals based on 
endoscopic diagnosis agreed with those based on 
pathology in 92.6% of patients (95% CI 87.9% to 
96.3%). 

Conclusions NBI diagnosis of colorectal polyps is 
highly accurate — the area under the HSROC curve 
exceeds 0.90. High-confidence predictions provide 
>90% sensitivity and NPV. It shows high potential for 
real-time endoscopic diagnosis. 



INTRODUCTION 

Colonoscopy with polypectomy is considered 
effective at preventing colorectal cancer deaths. 1 
However, its expense makes it potentially less cost 
effective than other screening methods. 2 All polyps, 
even diminutive polyps that rarely harbour dyspla- 
sia, 3 are routinely sent for pathological evaluation, 
and this can incur major costs. 4 Pathology diagnoses 
are needed to determine the patient's interval to the 



Significance of this study 



What is already known about this subject? 

► Pathological evaluation for polyps found at 
colonoscopy for colorectal cancer screening is 
expensive. 

► Narrow band imaging (NBI) makes neoplastic 
polyps appear darker, aiding in their 
differentiation from non-neoplastic lesions. 

► Many studies have evaluated the performance 
of endoscopic diagnosis with NBI compared 
with pathology. 

What are the new findings? 

► Real-time endoscopic diagnosis of colorectal 
polyps is a highly accurate test, with the area 
under the summary receiver operator curve 
exceeding >0.90. 

► Surveillance intervals dictated by endoscopic 
diagnosis agree with pathology-directed 
surveillance intervals in more than 90% of 
patients. 

How might it impact on clinical practice in 
the foreseeable future? 

► Endoscopists may move toward endoscopic 
diagnosis of colorectal polyps, forgoing 
pathological evaluation, particularly in 
high-confidence predictions. 

► Endoscopic diagnosis holds promise for making 
colonoscopy more cost effective and efficient 
by potentially avoiding the need for 
pathological examination. 

next surveillance colonoscopy. 5 Real-time endo- 
scopic diagnosis, in which endoscopists diagnose 
polyp histology at the moment of identification, 
may have similar diagnostic operating characteristics 
as pathological evaluation at a significantly reduced 
cost. 

Narrow band imaging (NBI) technology high- 
lights the increased vasculature of neoplastic tissue 
and makes neoplastic polyps appear darker than 
surrounding mucosa. This allows for improved dif- 
ferentiation of polyps compared with that using 
white light. 6 As such, an international classification 
to distinguish neoplasms such as adenomas from 
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Figure 1 Endoscopic image with narrow band imaging of diminutive colorectal polyps. (A) Adenoma and (B) non-neoplastic polyp. 



non-neoplasms such as hyperplastic polyps with the use of NBI 
has been developed and validated (figure 1)7 Real-time differen- 
tiation has been proposed as part of a 'resect and discard' strat- 
egy in which diminutive (<5 mm) neoplastic polyps are resected 
without pathological evaluation, and diminutive rectosigmoid 
non-neoplastic polyps are left in situ. 8 Such a strategy could 
allow for surveillance intervals to be communicated to the 
patient on the day of colonoscopy, and confer substantial cost 
savings by avoiding pathology and endoscopy fees. 4 9 It could 
also decrease unnecessary polypectomy, a risk factor for major 
colonoscopy-related complications such as perforation and 
bleeding. 10 

The potential for applying the 'resect and discard' strategy to 
clinical use depends to a large extent on the accuracy of real- 
time endoscopic diagnosis. Numerous prospective studies have 
compared endoscopic diagnosis of polyps with NBI to a refer- 
ence standard of histology. These data are valuable to allow us 
to understand its diagnostic operating characteristics, which, in 
turn, could provide insights of its potentials for clinical use. The 
aim of this study was to carry out a systematic review and 
meta-analysis on the real-time performance of endoscopic 
diagnosis. 

METHODS 

Search strategy and study selection 

We (TK and SM) conducted a computerised literature search of 
the PubMed, SCOPUS (including EMBASE) and Cochrane 
Library databases up to June 2012. In addition, we searched 
the abstracts of conference proceedings of Digestive Diseases 
Week and American College of Gastroenterology. We designed 
the search queries with a biomedical research librarian to 
capture all articles related to NBI and colonoscopy. Studies in 
PubMed were identified with the terms narrow band or optical 
filter combined with the set operator AND with studies identi- 
fied with the MeSH terms colonoscopy, colonic neoplasms or 
colonic polyps or with words beginning with colored, 
adenoma, colonoscop or polyp. Studies in SCOPUS were iden- 
tified with the terms narrow band or optical filter combined 
with the set operator AND with words beginning with color- 
ed, adenoma, colonoscop or polyp. The electronic archives of 
conference proceedings were searched using the term narrow 
band, and abstracts that included this term were reviewed in 
detail for potential inclusion. We subsequently manually 
searched the citations from published reviews. Following the 
initial search, we identified articles for appropriateness, and 
performed a detailed full text assessment of potentially relevant 
studies. 



We included studies that prospectively evaluated patients 
undergoing colonoscopy during which endoscopists used NBI 
to make a real-time prediction of polyp histology (neoplastic or 
non-neoplastic), and compared this with histology as the refer- 
ence standard. We excluded studies that primarily analysed still 
images to predict polyp histology; those that included patients 
with inflammatory bowel disease, hereditary nonpolyposis colo- 
rectal cancer or familial polyposis syndromes; as well as those 
primarily designed as a retrospective study, review, editorial or 
meta-analysis. We translated papers that were not written in 
English. We discussed and resolved disagreement between inves- 
tigators. Our protocol is available by request. 

Data extraction 

We extracted data independently onto standardised paper forms. 
We constructed 2x2 tables that contained the number of polyps 
found to be true positives (neoplastic polyps that were endoscop- 
ically predicted to be neoplastic), true negatives (non-neoplastic 
polyps that were endoscopically predicted to be non-neoplastic), 
false positives (non-neoplastic polyps that were endoscopically 
predicted to be neoplastic) and false negatives (neoplastic polyps 
that were endoscopically predicted to be non-neoplastic). When 
possible, additional 2x2 tables were constructed for polyps 
<5 mm, 6-9 mm and >10 mm, and high-confidence and low- 
confidence predictions. In general, a real-time diagnosis was 
described as high confidence when the polyp had endoscopic fea- 
tures strongly suggestive of its pathology, and the endoscopist 
could make a clinical management and surveillance decision 
based on his or her endoscopic diagnosis. We contacted study 
authors when there were insufficient published data to construct 
the 2x2 table for all results. In addition, the following data were 
extracted for each trial, when available: period of enrolment, 
number of endoscopists who individually performed colonos- 
copies on patients in the cohort, number of these who were 
expert endoscopists, total number of patients enrolled, number 
of patients with polyps examined by NBI for accuracy data, inclu- 
sion and exclusion criteria for participants; patient data including 
age, sex and indication for colonoscopy; size criterion for polyps 
examined for real-time diagnosis; polyp location, size and shape 
by Paris classification 11 ; and histology. We also extracted the 
diagnostic criteria used to differentiate neoplasms from non- 
neoplasms, and the features of the diagnostic modalities used, 
including NBI LUCERA or EXERA processor systems, high 
definition or high resolution, and the use of optical or digital 
magnification. Expert endoscopists were defined as those attend- 
ing endoscopists with significant experience performing colonos- 
copy and using NBI. 
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Figure 2 Flow chart of the search 
strategy and selected studies. 



Records identified via 
SCOPUS search (n=208) 

Records identified via 
Cochrane search (n=193) 



Records identified via 
PubMed search (n=461) 



Additional studies 
identified from meeting 
abstracts (n=10) 




Full-text articles assessed 
for eligibility (n=52) 



Eligible published 
studies (n=18) 



Excluded: 
Diagnosis made via 
still image review (n=14) 45 ' 58 

Review (n=5) 59 ' 63 
HNPCC population (n=4) 64 ' 67 
Editorial (n=1) 68 
Grouped data from trials 
already included (n=1) 69 
Retrospective (n=4) 70 " 73 
Meta-analysis (n=2) 74 - 75 
Systematic Review (n=1) 76 
N on-neo plasm s ex clud ed from 

study (n=1) 77 
N o comparison to pathology 
(n=1) 78 



Eligible studies for meta- 
analysis (n=28) 



Study quality assessment 

To assess study quality and potential for bias, we used the 
Quality Assessment of Diagnostic Accuracy Studies-2 
(QUADAS-2) tool. 12 We rated the quality of key study design 
characteristics such as prespecified inclusion and exclusion cri- 
teria, defined diagnostic criteria, blinding of endoscopists to the 
pathological diagnosis, description of a reference standard and 
the inclusion of all patients in the analysis. 

Statistical methods 

We performed a bivariate meta-analysis using a linear mixed 
model approach to calculate summary estimates of sensitivity, 
specificity, positive likelihood ratio and negative likelihood ratio, 
and to fit a hierarchical summary receiver-operating characteris- 
tic (HSROC) curve. 13 14 We used summary estimates of sensitiv- 
ity and specificity to estimate the negative and positive 
predictive values when neoplasms accounted for 60%, 50%, 
40% and 30% of all polyps based on prior published 
values. 3 15 16 We performed prespecified subgroup analyses for 
published studies alone, diminutive polyps, high-confidence pre- 
dictions, diminutive high-confidence predictions, diagnoses with 
NBI LUCERA and EXERA systems. To perform a sensitivity 
analysis, we performed subgroup analyses for high-quality and 
highest-quality studies, which were not prespecified. We calcu- 
lated the area under the HSROC curve for the main analysis 
and subgroup analyses. We used random effects to calculate 
summary estimates for feasibility of high-confidence diagnoses 
and assessed agreement of surveillance interval recommenda- 
tions based on endoscopic diagnosis compared with those based 
on the pathological diagnosis. We used Stata VI 1 to perform 
the calculations. 

RESULTS 
Eligible studies 

Twenty-eight studies consisting of 18 full published papers 6 17-33 
and 10 abstracts 34-43 fulfilled the study inclusion criteria and 
were analysed. These 28 studies were selected from 711 screened 
citations. We excluded 658 citations based on the title and 



abstract. Of the 52 articles selected for full text review, 14 were 
excluded as they had predicted polyp histology based on still 
images, 44-57 5 were review articles, 58-62 4 were excluded because 
they involved a hereditary nonpolyposis colorectal cancer popu- 
lation, 63-66 and 11 exclusions were based on other criteria 67-77 
(figure 2). Eventually, we identified 18 papers and 14 abstracts 
that met eligibility criteria. Four abstracts 78-81 with a total of 541 
polyps (359 patients) were subsequently excluded for missing 
data despite contacting the investigators. 

Study characteristics 

The 28 studies included a total of 6280 polyps that were diag- 
nosed in 4053 patients. The characteristics of the included 
studies are listed in table 1. Fourteen studies were performed in 
the USA, seven in Asia, six in Europe and one in Australia. 
Twenty studies used the EXERA; eight used the LUCERA 
systems of NBI. The criteria used for prediction of polyp hist- 
ology varied: six used Kudo pit pattern classification, four used 
the Narrow Band Imaging International Colorectal Endoscopic 
(NICE) classification, and others used less defined criteria of 
polyp colour or vascular pattern. Overall, 63% of all polyps 
analysed were neoplastic — the range was from 38% to 89%. 

Quality assessment 

In general, the included studies met most of the quality criteria 
(table 2). However, in many studies it was not clear whether a 
consecutive or random sample of patients was enrolled, and 
whether all patients were included in the analysis, both of which 
might have introduced bias. 

Diagnostic performance of NBI diagnosis 

Endoscopic diagnosis of colorectal polyps with NBI showed 
highly accurate diagnostic performance — the area under the 
HSROC curve was 0.92 (95% CI 0.90 to 0.94) (figure 3). For 
high-confidence predictions alone reported by eight studies, the 
area under the HSROC curve was 0.95 (95% CI 0.93 to 0.97), 
and for high-confidence predictions of diminutive polyps, the 
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Table 1 Study characteristics 



No. of neoplasms/ Polyps, n (%) 
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Endoscopists 


No. of 


Patients 
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No. of 


with high 
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1 1 iuuciii ly 
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1 IUI 1 


experts 
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CM Idly jCU 
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ul IdlyjCU 




rnnfiHpnrp nrpHirtinrK 

V.UI 1 1 IUCI IV-C IJI CvllLUUI 13 


Buchner etal (201 0) 1 7 


1 


USA 


Exera 


Kudo 


2 


2 


75 


41 


25/16 




Henry ef al (201 0) 19 


2 


USA 


Exera 


Sano-Emura 


1 


1 


52 


126 


67/59 




Hirata et al (2007) 69 


3 


Japan 


Lucera 


Brown hue 


2 


2 


99 


148 


132/16 




Ignjatovic et al (2009) 20 


4 


UK 


Lucera 


Vascular pattern intensity 


4 


2 


130 


169 


129/40 


* 


Lee ef al (201 1) 21 


5 


South Korea 


Lucera 


Mucosal pattern and vascular 
density 


1 


1 


142 


156 


80/76 


125 (80.1%) 


Machida ef al (2004) 23 


6 


Japan 


Lucera 


Kudo 


2 


2 


34 


43 


34/9 




Rastogi etal (2009) 24 


7 


USA 


Exera 


Type A: HP 
Type B: TA 


1 


1 


101 


236 


143/93 




Rastogi etal (201 1) 6 


8 


USA 


Exera 


Type A: HP 
Type B: TA 


6 


6 


134 


384 


147/237 




Rex (2009) 22 


9 


USA 


Exera 


Pre NICE* 


1 


1 


136 


451 


230/221 


368 (81.6%) 


Rogart efa/ (2008) 26 


10 


USA 


Exera 


Vascular density, modified Kudo 


4 


4 


302 


265 


129/134 




Rotondano ef al (201 1 ) 27 


11 


Italy 


Lucera 


Kudo 


3 


3 


94 


281 


141/140 




Sakamoto ef al (201 2) 28 


12 


Japan 


Lucera 


Sano 


1 


1 


80 


116 


52/42 




Sano ef a/ (2009) 29 


13 


Japan 


Lucera 


Sano 


1 


1 


92 


150 


111/39 




Shahid etal (201 1) 30 


14 


USA 


Exera 


Sano 


1 


1 


65 


130 


58/72 




Singh efa/ (201 1) 31 


15 


Australia 


Exera 


Sano 


1 


1 


32 


50 


30/20 


50 (100%) 


Zhou etal (201 1) 32 


16 


China 


Lucera 


Kudo and Sano 


1 


1 


118 


109 


67/42 




Ren (201 2) 25 


17 


China 


Exera 


Yoshiki 


1 


1 


75 


116 


52/42 




Kuiperef al (201 2) 33 


18 


The 

Netherlands 


Exera 


Kudo 


3 


0 


108 


281 


141/140 


231 (82.2%) 


Abstracts 
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0 
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Hewettand Rex (201 0) 36 


20 


USA 


Exera 


Pre NICE* 


1 


1 


225 


235 


38/197 




Kaltenbach etal (201 1) 38 


21 


USA 


Exera 


NICE 


2 


2 


220 


236 


146/90 


178 (75.4%) 


Kaltenbach etal (201 2) 39 


22 


USA 


Exera 


NICE 


5 


5 


311 


338 


233/105 


246 (72.8%) 


Matthew etal (2008) 34 


23 


USA 


Exera 


Reported patterns 


1 


0 


100 


231 


106/125 




Occhipinti etal (201 1) 37 


24 


Italy 


Exera 


Kudo 


5 


5 


93 


220 


120/100 




Pohl etal (201 2) 40 


25 


USA 


Exera 


NICE 


10 


NR 


608 


948 


528/420 


770 (81.3%) 


Radaelli efa/ (201 1) 41 


26 


Italy 


Exera 


NR 


NR 


all 


197 


354 


233/121 


354* 


Ringold ef al (2008) 35 


27 


USA 


Exera 


'Cerebriform' 


4 


4 


55 


93 


56/37 




Yague ef al (201 1) 42 


28 


Spain 


Exera 


Vascular patterns 


1 


1 


75 


215 


107/108 





* Information on the number of polyps predicted with low confidence was not provided. 

NICE, Narrow Band Imaging International Colorectal Endoscopic Classification. This classification system includes criteria on polyp colour, vessels and surface pattern; NR, not reported; Pre NICE, classification systems based on similar criteria that 
preceded NICE. 



Table 2 The quality assessment of diagnostic accuracy studies-2 tool for quality assessment of the included studies 



Author 


DOM1A1 


DOM1A2 


DOM 1 A3 


DOM 1A4 


DOM1B DOM2A1 


DOM 2A2 


DOM 2A3 DOM 2B DOM 3A1 


DOM 3A2 


DOM 3A3 


DOM 3B 


DOM 4A1 


DOM 4A2 


DOM4A3 


DOM4A4 


DOM 4A5 


Buchner ef a/ 17 


Y 


Y 


Y 


L 


L Y 


Y 


L L Y 


Y 


L 


L 


U 


Y 


Y 


Y 


L 


Henry ef a/ 19 


Y 


Y 


Y 


L 


L Y 


Y 


L L Y 


U 


U 


U 


Y 


Y 


Y 


Y 


L 


Hirata etal 69 


U 


Y 


U 


U 


H Y 


Y 


L U Y 


Y 


L 


L 


Y 


Y 


Y 


U 


U 


Ignjatovic ef a/ 20 


Y 


Y 


Y 


L 


H Y 


Y 


L L Y 


Y 


L 


L 


U 


Y 


Y 


N 


L 


Lee efa/ 21 


Y 


Y 


Y 


L 


L Y 


Y 


L U Y 


Y 


L 


L 


Y 


Y 


Y 


Y 


L 


Machida ef a/ 23 


U 


Y 


U 


U 


U Y 


Y 


L L Y 


U 




L 


Y 


Y 


U 


U 


U 


Rastogi ef a/ 24 


U 


Y 


Y 


U 


L Y 


Y 


L L Y 


Y 


L 


L 


Y 


Y 


Y 


Y 


L 


Rastogi ef a I s 


U 


Y 


Y 


u 


L Y 


Y 


L L Y 


Y 


L 


L 


Y 


Y 


Y 


N 


U 


Rex 22 


U 


Y 


U 


u 


U Y 


Y 


L L Y 


Y 


L 


L 


U 


Y 


Y 


U 


U 


Rogart ef a/ 26 


Y 


Y 


Y 


L 


L Y 


Y 


L L Y 


Y 


L 


L 


U 


Y 


Y 


U 


u 


Rotondano ef a/ 27 


U 


Y 


Y 


L 


L Y 


Y 


L H Y 


Y 


L 


L 


Y 


Y 


Y 


Y 


L 


Sakamoto ef a/ 28 


Y 


Y 


U 


U 


L Y 


Y 


H H Y 


Y 


L 


L 


U 


Y 


Y 


Y 


L 


Sano ef a/ 29 


Y 


Y 


Y 


L 


L Y 


Y 


L L Y 


Y 


L 


L 


U 


Y 


Y 


Y 


L 


Shahid ef a/ 30 


Y 


Y 


U 


U 


L Y 


Y 


L L Y 


Y 


L 


L 


u 


Y 


Y 


U 


U 


Singh ef a/ 31 


U 


Y 


Y 


U 


L Y 


Y 


L L Y 


Y 


L 


L 


u 


Y 


Y 


Y 


L 


Zhou ef a/ 32 


U 


Y 


Y 


L 


L Y 


Y 


L L Y 


Y 


L 


L 


Y 


Y 


Y 


Y 


L 


Ren 25 


U 


Y 


Y 


U 


L Y 


Y 


L L Y 


U 




L 


Y 


Y 


Y 


N 


U 


Kuiper ef a/ 33 


U 


Y 


Y 


U 


L Y 


Y 


L L Y 


Y 


L 


L 


Y 


Y 


Y 


Y 


L 


Abstracts 
































Coe efa/ 43 


U 


Y 


U 


u 


L Y 


Y 


L L Y 


Y 






Y 


Y 


U 


Y 


L 


Hewettef a/ 15 


u 


Y 


U 


u 


U Y 


U 


U L Y 


Y 






Y 


Y 


Y 


N 


U 


Kaltenbach ef a/ 38 


Y 


Y 


Y 


L 


L Y 


Y 


L L Y 


Y 






Y 


Y 


Y 


Y 


L 


Kaltenbach efa/ 39 


Y 


Y 


Y 


L 


L Y 


Y 


L L Y 


Y 






Y 


Y 


Y 


Y 


L 


Matthew ef a/ 34 


Y 


Y 


Y 


L 


L Y 


U 


U L Y 


U 






U 


Y 


Y 


Y 


L 


Occhipinti ef a/ 37 


Y 


Y 


U 


U 


L Y 


Y 


L L Y 


U 






Y 


Y 


Y 


U 


U 


Pohl efa/ 40 


U 


Y 


U 


u 


L Y 


Y 


L L Y 


U 






Y 


Y 


Y 


U 


U 


Radaelli efa/ 41 


Y 


Y 


Y 


L 


L Y 


U 


U L Y 


Y 






Y 


Y 


Y 


Y 


L 


Ringold ef a/ 35 


U 


Y 


Y 


U 


L Y 


Y 


L L Y 


U 


U 




U 


Y 


Y 


U 


U 


Yague ef a/ 42 


U 


Y 


U 


u 


L Y 


Y 


L L Y 


u 


U 


U 


Y 


Y 


Y 


U 


U 



DOM, domain; DOM1A1, consecutive or random sample of patients enrolled; DOM1A2, case-control design avoided; DOM1A3, study avoided inappropriate exclusions; DOM1A4, selection of patients introduced bias; DOM1B, concern that included 
patients do not match the review question; DOM2A1, index test results interpreted without knowledge of results of reference standard; DOM2A2, prespecified threshold used; DOM2A3, could the conduct of index test have introduced bias; Dom2B, 
concern that index test conduct or interpretation differ from review question; DOM3A1, reference standard correctly classifies condition; DOM3A2, reference standard results interpreted independently from index test results; DOM3A3, could the 
reference standard, its conduct, or its interpretation have introduced bias; DOM3B, concern that target condition defined by reference standard does not match review question; DOM4A1, appropriate interval between index test and reference standard; 
DOM4A2, all patients received the reference standard; DOM4A3, patients received the same reference standard; DOM4A4, all patients included in the analysis; DOM4A5, could the patient flow have introduced bias; H, high; L, low; N, no; U, unclear; Y, 
yes. 
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- All 95% prediction region 
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Figure 3 Hierarchical summary receiver-operating characteristic 
(HSROC) curve for the diagnostic performance of narrow band imaging 
to diagnose neoplastic and non-neoplastic polyps among all studies 
(blue line) and among published studies (green line). The size of the 
circles indicates the weight of the individual studies. The summary 
sensitivity and specificity is shown with a yellow square and the 95% 
confidence region is plotted. For all studies, the area under the HSROC 
curve was 0.92 (95% CI 0.90 to 0.94); for published studies, the area 
under the HSROC curve was 0.93 (0.90 to 0.95). 

area under the HSROC curve was 0.92 (95% CI 0.92 to 0.96) 
(figure 4). 

The main results are presented in table 3 . The overall sensitiv- 
ity of NBI diagnosis was 91.0% (95% CI 87.6% to 93.5%) and 
specificity was 82.6% (95% CI 79.0% to 85.7%) compared 
with histology. In six studies (n=1567 polyps) that provided 
information on high-confidence and low-confidence predictions, 
a high-confidence prediction was made in 77% of polyps (95% 
CI 73.3% to 80.7%). In eight studies (n=2146 polyps) that pro- 
vided information on high-confidence predictions, the sensitiv- 
ity and specificity for diagnosis made with high confidence was 
93.8% and 83.3%, respectively. The sensitivity and specificity of 
diagnosis of diminutive polyps, made with high confidence was 
93.4% (95% CI 87.4% to 96.7%) and 84.0% (95% CI 76.6% 
to 89.3%), respectively. The negative predictive values (NPVs) 
overall were 86.0%, 90.1%, 93.2% and 95.5% and for high- 
confidence predictions improved to 90.0%, 93.0%, 95.3% and 
96.9% when neoplasms account for 60%, 50%, 40% and 30% 
of all polyps, respectively. 

The likelihood ratio synthesis gave an overall LR+ of 5.2 
(95% CI 4.3 to 6.4) and LR- of 0.11 (95% CI 0.08 to 0.15). 
Results were similar when limited to published papers, and 
improved for high-confidence and diminutive polyps. 

Surveillance intervals based on NBI diagnosis 

Seven studies — three papers 20 22 33 and four abstracts 38-41 — 
reported surveillance intervals based on endoscopic diagnosis. 
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Figure 4 Hierarchical summary receiver-operating characteristic 
(HSROC) curve for the diagnostic performance of narrow band imaging 
to diagnose diminutive polyps (blue line) and diminutive polyps that 
were diagnosed with high confidence (green line). For high-confidence 
predictions of diminutive polyps, area under the HSROC curve was 0.94 
(95% CI 0.92 to 0.96). 



Overall, surveillance intervals based on endoscopic diagnosis 
were the same as those based on formal pathology in 92.6% of 
patients (95% CI 87.9% to 96.3%). There was statistically sig- 
nificant heterogeneity in the agreement rates across studies 
(p=4xl0 -8 for Q statistic). If we exclude the studies by 
Radaelli et al 41 and Kuiper et al 33 who reported significantly 
less agreement at 83.2% and 81.4%, respectively, heterogeneity 
is not significant (p = 0.28 for Q statistic) and the surveillance 
intervals agree in 95.5% of patients (95% CI 93.9% to 96.9%). 
Among the six studies that reported whether endoscopically 
directed intervals were shorter or longer than those directed by 
pathology, 20 22 33 38 39 41 39 patients (3.0%) were prescribed 
shorter intervals and 35 patients (2.7%) were prescribed longer 
intervals (figure 5). 

Sensitivity analysis 

We performed sensitivity analyses with five studies rated of the 
highest quality (all risk for bias low) and 12 of high quality (all 
risk for bias low or low except one which was unknown). 
Diagnostic operating characteristics were similar compared with 
all results (table 3, figure 6). 

DISCUSSION 

The findings of this meta-analysis suggest that real-time endo- 
scopic diagnosis of colorectal polyps performed using NBI has a 
high diagnostic performance, with an area under the HSROC 
curve exceeding 0.90. Endoscopic diagnosis correctly charac- 
terised 91% of neoplasms and 83% of non-neoplastic polyps, 
and these numbers improved with high-confidence predictions 
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Table 3 Diagnostic accuracy of endoscopic diagnosis with NBI to distinguish between neoplastic and non-neoplastic colorectal neoplasms 



Summary estimates (95% CI) 



Likelihood ratio (95% CI) 



Study characteristics 


No. of studies (no. of polyps) 


Sens 


Spec 


LR+ 


LR— 


Area under HSROC curve (95% CI) 


All 


28 (6280) 


91.0 (87.6 to 93.5) 


82.6 (79.0 to 85.7) 


5.2 (4.3 to 6.4) 


0.11 (0.08 to 0.1 5) 


0.92 (0.90 to 0.94) 


Published manuscripts 


18 (3212) 


91.7 (87.1 to 97.4) 


84.5 (80.4 to 87.9) 


5.9 (4.6 to 7.6) 


0.10 (0.06-0.16) 


0.93 (0.90-0.95) 


High-confidence predictions 20 " 22 31 38 ~ 41 


8 (2146) 


93.8 (90.1 to 96.2) 


83.3 (77.1 to 88.1) 


5.6 (4.0 to 7.8) 


0.07 (0.05 to 0.12) 


0.95 (0.93 to 0.97) 


Polyps <5 mm 19 21 22 30 38 39 


7 (1942) 


86.3 (78.4 to 91.7) 


84.1 (75.5 to 90.1) 


5.4 (3.6 to 8.2) 


0.16 (0.11 to 0.25) 


0.92 (0.89 to 0.94) 


High-confidence predictions for polyps <5 mm 21 22 38-40 


5 (1350) 


93.4 (87.4 to 96.7) 


84.0 (76.6 to 89.3) 


5.8 (4.0 to 8.6) 


0.08 (0.04 to 0.15) 


0.94 (0.92 to 0.96) 


Exera 


20 (5148) 


89.4 (85.0 to 92.6) 


81.6 (77.3 to 85.2) 


4.9 (3.9 to 6.0) 


0.13 (0.09 to 0.18) 


0.91 (0.89 to 0.94) 


Lucera 


8 (1132) 


94.0 (88.7 to 96.9) 


86.0 (81.1 to 89.8) 


6.7 (4.9 to 9.2) 


0.07 (0.04 to 0.13) 


0.95 (0.93 to 0.97) 


Highest-quality studies 17 29 32 38 39 


5 (826) 


91.5 (86.0 to 94.8) 


87.2 (74.7 to 94.1) 


7.2 (3.4 to 15.0) 


0.10 (0.06 to 0.16) 


0.95 (0.93 to 0.97) 


High-quality studies 17 21 24 26 29 31 " 33 38 39 41 43 


12 (2428) 


88.3 (83.6 to 91.8) 


85.3 (80.3 to 89.2) 


6.0 (4.3 to 8.4) 


0.14(0.09 to 0.20) 


0.93 (0.91 to 0.95) 



HSROC, hierarchical summary receiver-operating characteristic; NBI, narrow band imaging. 
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estimates of test sensitivity and specificity are simply pooled or 
averaged. Our analysis is the largest to address the topic; a prior 
meta-analysis by Wu et al 74 included only 11 prospective 
studies, 6 of which differentiated polyps based on still images. 
The only real-time diagnosis study 75 in a meta-analysis by van 
den Broek et al 77 excluded non-neoplastic polyps from its 
analysis. 

Our study addresses the standards set forth by the American 
Society of Gastrointestinal Endoscopy (ASGE) for the 'resect 
and discard' strategy. The ASGE has proposed that, for endo- 
scopically diagnosed adenomas <5 mm in size to be resected 
and discarded without pathologic assessment, endoscopic diag- 
nosis should provide a >90°/o agreement in assignment of post- 
polypectomy surveillance intervals compared with decisions 
based on pathology. 83 The summary agreement was 92.6% in 
our study, supporting the clinical use of such a strategy. 

Our results also relate to the 'diagnose and leave in' strategy 
of leaving endoscopically predicted diminutive non-neoplastic 
recto-sigmoid polyps in situ without resection. The ASGE 
recommended that to implement such a policy, endoscopic diag- 
nosis should provide >90% NPV when used with high confi- 
dence. 83 Our calculated NPV for high-confidence NBI 
diagnosis, derived using the summary sensitivity and specificity, 
meets this requirement when neoplastic polyps account for less 
than 60% of all polyps. This is true in prior studies that have 
reported polyp findings in the entire and recto-sigmoid colon. 
Lieberman et al 3 found that 50% of 3744 diminutive polyps 
were neoplastic using a large database of colonoscopies per- 
formed at academic and private practices. Pickhardt et al 16 
found that 36.5% of 977 diminutive polyps were neoplastic; 
Hewett et al 15 found that only 20% of 235 rectosigmoid 
diminutive polyps were neoplastic. 

The rationale for real-time histology of colorectal polyps is 
based on the literature that diminutive polyps rarely harbour 
advanced histology such as villous features, high-grade dysplasia 
or cancer, 3 and that pathologists are 85-95% accurate in polyp 
histology characterisation. 84 85 Nonetheless, shifting colorectal 
polyp diagnosis from the traditional gold standard pathology to 
endoscopy is likely to cause much reservation across the field in 
regards to accountability, particularly in the strategy of forgoing 
resection. The importance of high-quality photo documentation 
of the polyp, in lieu of a pathology slide, must be underscored. 
The high-resolution polyp image should be permanently stored 
with the procedure report and accessible in the future as the ref- 
erence to support the endoscopists' assessment and clinical deci- 
sion when subjected to quality review. 

The agreement of surveillance intervals is important. In 
theory, longer surveillance intervals could allow for progression 
of neoplasia in high-risk individuals before follow-up while 
inappropriately short surveillance intervals could result in 
unnecessary colonoscopy, making the strategy less cost effective. 
In our study, when endoscopy-directed surveillance intervals dis- 
agreed with those dictated by pathology, roughly half the recom- 
mended longer follow-up and the other half, earlier follow-up. 
The majority of studies that reported surveillance intervals met 
the threshold of concordance for high-confidence predictions 
suggested by the ASGE. There were two exceptions that contrib- 
uted to between-study heterogeneity. Kuiper and coauthors' 
study, 33 which uniquely focused on non-academic endoscopists, 
suggests they may have diminished accuracy compared with 
experts and require more or continued learning to achieve and 
sustain high performance. However, it is difficult to draw such a 
conclusion from a single study. The second study by Radaelli 
et al 41 assesses expert endoscopists and it is unclear from the 



abstract why they had relatively worse agreement with histology 
than the other studies. 

Recent evidence suggests that serrated polyps with features of 
larger size, sessile serrated polyp histology, cytologic dysplasia 
and location in the proximal colon may have a higher risk of 
colorectal cancer. As such, guidelines for colonoscopy surveil- 
lance after screening and polypectomy have recently been 
updated to stratify serrated lesions. 5 The consensus recom- 
mended that a sessile serrated polyp larger than 9 mm and a 
sessile serrated polyp with cytological dysplasia should be 
managed like a high-risk adenoma; and serrated polyps that are 
less than 10 mm and do not have cytological dysplasia can be 
managed like a low-risk adenoma. Current endoscopic classifica- 
tion systems for the differentiation of polyp histology, however, 
do not address how to distinguish sessile serrated polyps from 
hyperplastic lesions, mainly due to the high inter-observer vari- 
ability for their pathological diagnosis, and consequent lack of a 
reference standard. In the future, serrated polyps will need to be 
formally studied and integrated into the real-time histology 
strategy. 

Our results reflect the important use of confidence levels. The 
highest performance of real-time NBI diagnosis of colorectal 
polyps was achieved when the diagnosis was made with high 
confidence — the area under the HSROC curve was 0.95 (95% 
CI 0.93 to 0.97) for polyps of any size, and 0.92 (95% CI 0.92 
to 0.96) for diminutive ones. This compares to the overall area 
under the HSROC curve of 0.92 (95% CI 0.90 to 0.94). The 
use of objective validated criteria for the endoscopic differenti- 
ation of colorectal polyp histology can guide the physician in 
determining the confidence level. For example, a high- 
confidence diagnosis can be made if the polyp has one or more 
features as described in the classification and no features asso- 
ciated with the other polyp histology. If features are not present, 
then a low-confidence diagnosis can be made, and the polyp 
submitted for pathological assessment. 

We analysed data of over 6000 polyps among 4053 patients 
who spanned four continents. Nonetheless, the main limitation 
to our study is that of generalisability. Most studies were per- 
formed with expert endoscopists who used variable classification 
methods to differentiate adenomas from non-neoplastic polyps. 
The results could be widely generalised if non-experts can 
readily learn endoscopic diagnosis; only preliminary studies 
exist, and results are mixed. 33 57 86-88 Furthermore, the recent 
publication of validated international criteria specifically devel- 
oped for colorectal polyps differentiation using NBI 7 holds 
promise for making endoscopic diagnosis more standardised 
and less operator dependent. Teaching tools such as videos 88 
and computer modules 86 may be important in the initial and 
continued training of endoscopists on polyp differentiation. 

The exact number of NBI procedures needed to achieve profi- 
ciency in optical diagnosis is currently unknown. We identified 
two studies that address the potential learning curve for real- 
time endoscopic diagnosis. In Rogart et aPs 26 series of 265 
polyps in 131 patients, three of four endoscopists significantly 
improved their accuracy in the second half of the study com- 
pared with the first from 74% to 87%, respectively. In that 
study, endoscopists received feedback every 2 weeks about the 
accuracy of their endoscopic diagnosis. This suggests that with 
frequent feedback among experienced endoscopists, significant 
gains in accuracy can be attained in a relatively short amount of 
time. The other study was a single endoscopist study, which 
showed higher accuracy for polyps evaluated in the second half 
of study than the first. The difference however was not statistic- 
ally significant. 24 
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Another potential limitation is publication bias. We searched 
for information included in meeting abstracts. We cannot totally 
exclude that some studies with poor diagnostic performance 
may have remained unpublished and not even presented in 
major meetings. However, these studies would have to be large 
to change substantially the results of the meta-analysis. 

In conclusion, we found that endoscopic diagnosis with NBI is an 
accurate test to differentiate neoplastic from non-neoplastic polyps, 
with an area under the HSROC curve exceeding 0.90. Its sensitivity 
for diagnosing adenomatous and other neoplastic polyps is >90%, 
as is the agreement between endoscopically derived and histologi- 
cally derived surveillance intervals. Its NPV is high as long as 
neoplasms account for < 60% of polyps. Endoscopic diagnostic per- 
formances are highest with high-confidence predictions. 
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